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Abstract 

With modem data acquisition devices that work fast and very precise, scientists 
often face the task of deahng with huge amounts of data. These need to be rapidly 
processed and stored onto a hard disk. We present a Lab VIEW program which 
rehably streams analog time series of MHz sampling. Its run time has virtually no 
limitation. We explicitly show how to use the program to extract time series from 
two experiments: For a photodiode detection system that tracks the position of an 
optically trapped particle and for a measurement of ionic current through a glass 
capillary. The program is easy to use and versatile as the input can be any type 
of analog signal. Also, the data streaming software is simple, highly reliable, and 
can be easily customized to include, e.g., real-time power spectral analysis and Allan 
variance noise quantification. 
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Memory usage: Code 40.5 Kbyte, front panel 50.7 Kbyte, block diagram 444.1 Kbyte; 
total VI file size 77.7 Kbyte 
Classification: Data acquisition program 

Nature of problem: For numerous scientific and engineering applications, it is highly 
desirable to have an efficient, reliable, and ffexible program to perform data stream- 
ing of time series sampled with high frequencies and possibly for long time intervals. 
This type of data acquisition often produces very large amounts of data not easily 
streamed onto a computer hard disk using standard methods. 

Solution: This Lab VIEW program is developed to directly stream any kind of time 
series onto a hard disk. Due to optimized timing and usage of computational re- 
sources, such as multicores and protocols for memory usage, this program provides 
extremely reliable data acquisition. In particular, the program is optimized to deal 
with large amounts of data, e.g., taken with high sampling frequencies and over long 
time intervals. The program can be easily customized for time series analyses. 
Restrictions: Only tested in Windows-operating Lab VIEW environments, must use 
TDMS format, acquisition cards must be Lab VIEW compatible, driver DAQmx in- 
stalled. 

Running time: as desirable: microseconds to hours 

Keywords: data acquisition, data streaming. Lab VIEW, TDMS, optical tweezers 
PACS: 87.80.Cc, 87.80.Ek, 07.05.Hd, 07.90.+C 



1. Introduction 

Precision experiments where data is acquired with high temporal resolution pose 
a challenge with respect to streaming and saving the data correctly onto a computer 
hard disk for further processing [1]. Within the nanoscience and biophysical com- 
munities. Lab VIEW is often the program of choice for control of data acquisition 
and streaming [213111]. Here, we present a highly reliable and efficient data stream- 
ing program in Lab VIEW. The program is built into modular blocks with the goal 
of making the design comprehensible and easily compatible for further customiza- 
tion. Also, user-friendliness has been highly valued and we show how to use the 
program to stream time series data from two typical nanoscale experiments: One 
involving optical trapping assays the other ionic current measurements through 
glass capillaries [6j. 
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2. Program Overview 



2.1. Requirements 

A time series can originate from a wide range of physical signals, such as temper- 
ature, voltage, current etc. The time series, most often in the form of parallel volt- 
age signals, enter the program through a number of channels of an acquisition card, 
building the interface between computers and experimental setups. Acquisition cards 
are available in a broad range for various tasks and quality requirements. We used 
National Instruments cards NI PCI-6251, NI PCIe-M6251, and NI PCI-M6040 [3. 
They are coupled into TimeSeriesStreaming.vi by DAQmx, a LabVIEW-internal 
driver. As precondition, the acquisition card must be compatible with Lab VIEW. 
This holds either for those that can be installed by National Instrument's Measure- 
ment and Automation Explorer, or for those supplied with a LabVIEW-compatible 
driver. 

2.2. Main Program 

The main program is designed in a modular fashion to offer independent as well 
as interconnected control of different sources of analog signals. Further, it contains 
support for data-streaming protocols. The programming architecture combines hori- 
zontal modules (acquisition, queuing, streaming) with vertical programming patterns 
(sequential structure, parallel while loops, multicore processing) in order to assure 
negligible error rates and optional customization. 

The different modules of the program are highlighted each by their background 
color in Figures [T] and |2} The four modules deal with elements that concern com- 
puter specifications (yellow), acquisition (blue), queuing (red), and streaming 
(green). Each of the modules functions independently from the others as it commu- 
nicates through well-defined programming patterns. 

The usage of the program will be explained in Section |3] 

Programming Patterns. Multicore processing is the ability to distribute computa- 
tional jobs over more than one core, i.e. one CPU. This feature has become available 
in recent versions of Lab VIEW. In TimeSeriesStreaming.vi multicore process- 
ing is implemented by assigning each timed loop to a specific core. On the tested 
systems, the CPU load of an individual core never exceeded 20%. Optimal multicor- 
ing was ensured by core assignments (highlighted yellow in Figure [2]). It could also 
compensate for occasional interruptions by the Windows XP operating system. 

Data acquisition must not be interrupted by waiting times during the streaming 
process. Lab VIEW is optimized for dataflow control. In TimeSeriesStreaming.vi 
this is achieved by transporting data packages between different loops exclusively 
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Figure 1: Front panel of TimeSeriesStreaming.VI. In- and outputs of the four program- 
ming modules are highlighted by background color: computer specifications (yellow), ac- 
quisition (blue), queuing (red), and streaming (green). Details regarding the user defined 
settings are given in Section [3| A high-resolution version of Figure [T] is available through 
|http://www.nbi.dk/^czerwin/TimeSeriesStreaming.html[ 

through built-in queues (highhghted red in Figure [2]). The streaming loop is not 
executed when the queue is empty. This strategy has proven very powerful, as it 
allows both loops to run as quickly as possible without potential disturbance by 
waiting times. 

Parallelizing allows for parallel execution of computational jobs. Data acquisition 
is done in one while loop, data streaming in a parallel loop. Very reliable stream- 
ing is achieved by the powerful data format TDMS (Technical Data Management 
Streaming, National Instruments). Using the primitive TDMS Vis allows for high 
performance streaming virtually with no limitation. 

3. How to use the program 

A hands-on introduction to TimeSeriesStreaming.VI is given in this section. 
The perspective user is guided through the modules in the program's front panel 
(Figure [T]). An experienced user could adjust the programming architecture in the 
block diagram at will (Figure [2]). 

The only computer specification that must be set is the processor assignment 
(highlighted yellow). The user can choose to perform processor assignment on quad- 
, duo-, or single-cores; or simply choose automatic in which case the program will 
usually assign the highest ordered cores. However, if the user is aware, e.g., that the 
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Windows operating system is utilizing certain cores, it might be beneficial to assign 
the cores manually. 

The acquisition module (highlighted blue) controls mainly the settings regarding 
the acquisition card for a particular measurement. The desired scan rate [Hz] must 
be given in units of Hertz. The physical channels must be specified. Devl/ai0:2 
denotes the signals input from Devi through the channels 0, 1, and 2 (e.g., x, and 
z coordinates of a recorded movement). The internal limits of recordable voltage 
signal minimum [V] and maximum [V] are set in order to optimize the resolution of 
the recorded time series. It is advisable to have these settings as close as possible to 
the extrema of the input time series, though, without cutting any of the data points. 

Acquisition cards are equipped with an on-board buffer of a certain size indicated 
by OnboardBuffer. event interval sets the number of data points in each interval. If 
this number does not exceed the limit given by OnboardBuffer, the data are optimally 
passed onto the memory. Therefore, it is recommendable to try to keep event interval 
smaller than OnboardBuffer. 
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Figure 2: Block diagram of TimeSeriesStreaming.vi. The four programming modules are high- 
lighted by background color: computer specifications (yellow), acquisition (blue), queuing 
(red), and streaming (green). This diagram illustrates the modular architecture of the program 
where horizontal modules (acquisition, queuing, streaming) can be combined with vertical program- 
ming patterns (sequential structure, parallel while loops). A high-resolution version of Figure [2] is 
available through http://www.nbi.dk/^czerwin/TimeSeriesStreaming.html, 

On left side of the front panel, a graph displays the output of the acquisition card 
in Volts for all specified channels. The graph Readout AcqCard shows the last package 
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passed to the memory. The values of minimum [V] and maximum [V] shall be set as 
vertical axis limits. At any time, the acquisition can be aborted by hitting STOP 
Acq Card. This will halt the execution of looped functions of the DAQmx driver. The 
indicators DAQ timeout and DAQ done light up, if one of these two reasons terminates 
loop and therewith the program. 

The graph Readout Queue (highlighted red) displays the last package of data 
passed through the queue to the streaming module. Utihzing a user-specified voltage 
interval here allows for an on-screen check, e.g., for whether data could be exposed 
to drift. The indicator Elements in Queue reveals the queue's filling level. 

Streaming and data storage are controlled by the settings highlighted in green. 
With number of events the user specifies the total number of event intervals to be 
acquired. Hence, the total number of data points will be: 

total number of points = number of events * event interval. 

how many? counts the processed number of events. The entries sped value, spec2 
value, and spec3 value are numerical values. They will be stored in the resulting 
TDMS file in the header to the recorded data. It can regard values the user wishes 
to keep with the data (e.g., laser power, particle dimensions, ...). 

The exact path for the TDMS file with the recorded data must be given. There- 
fore, replace [C:\filename.tdms] by an appropriate entry. Note that an already 
existing file will be overwritten by default. The program automatically returns the 
file name and stores it in the header of the TDMS file, title, description, and author 
can be defined by the user and are also stored in the file header. 

If the total number of data points has been streamed, or if the STOP streaming 
button has been pressed, the program terminates and the indicator streaming done 
lights up. All data recorded up to that point is available in the user defined TDMS 
file. Also, TDMS files could be access already during streaming, e.g., from inside 
another VI. 

Potential error messages are shown in the bottom right box. 
4. Data Format and Benchmarks 

Data Format. The data recorded with TimeSeriesStreaming.VI is stored in a 
TDMS file. TDMS is an open-source file format developed by National Instruments. 
It is a binary format optimized for data streaming, thus, it handles dynamically in- 
creasing files correctly. Also, one can access the file already during acquisition. There 
are three ways to access TDMS: Directly in Lab VIEW using the primitive TDMS 
Vis, by third-party plug-ins, or by the program Diadem (National Instruments). For 



6 



the latter method, it is essential to use Diadem version 11.1 or higher. Detailed 
information on how to use Diadem or how to export TDMS files into third-party 
products can be found under |http:/ /www.ni.com/tdms[ Third-party plug-ins exist, 
e.g., for Matlab, OpenOjfice, and Excel. Origin can open TDMS files directly. 

Benchmarks. We tested the performance and stability of TimeSeriesStreaming. vi 
on three different computers designated for data acquisition. Their specifications are 
made available through the program summary URL [8j. Since Lab VIEW only pro- 
vides acceptable performance on machines operating Windows, we were limited by 
the choice of the operating system. All tested CPU architectures (quad-, duo-, and 
single-core) proved to yield very good acquisition. Though, the highest level of cus- 
tomizability applied to multicore processors. We tested the acquisition cards NI 
PCI-M6040, NI PCI-6521, and NI PCIe-6521. Table 1 represents the benchmarks 
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Table 1: Benchmark of TimeSeriesStreaming. vi as performed on a NI PCI-6251 connected to 
a Windows XP computer running LabVIEW 8.6. Each individual run took 4096 s. Scan rate, 
number of channels, and buffer per channel were set. Maximum filling, file size, and error rate were 
determined. 



for the NI PCI-6251 card with thermal noise as input. Scan rate, number of channels, 
and buffer per channel were set. Then the program ran for 4096 s and maximum 
filling and file size were determined. An error was counted when two consecutive 
16-bit digits were exactly identical. The error rate was defined as number of errors 
divided by the number of data points. 

In addition, we simulated basically all voltage acquisition devices with the Mea- 
surement and Automation Explorer and performed benchmarks with TimeSeriesStream- 
ing. vi using the input from the simulated device. 
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5. Examples of Program Applications 

Two brief examples of how to use TimeSeriesStreaming.vi are described here. 
In addition, the program has already been used to reliably stream large time series 
from experiments involving optical trapping of micron-sized polystyrene spheres [3], 
gold nanorods [H], and quantum dots [TD]. Furthermore, we implemented an improved 
calibration protocol for optical tweezers that made use of the main programming 
features introduced here [TT] . 



Time [ms] 

50 100 




Frequency [Hz] Measurement interval [ms] 



Figure 3: Example of data acquisition and time series analyses applied to an optical trapping assay. 
A Positional time series of an 800 nm polystyrene sphere which is harmonically trapped. Its lateral 
positions x (grey) and y (black, offset 50 nm) are recorded by a photodiode detection system. The 
power spectral density (B) and the Allan deviation (C) of the lateral positions visited. 



5.1. Position Recording in Optical Tweezers 

The development of TimeSeriesStreaming.vi was prompted by a need to 
stream large amounts of data from optical trapping assay to a hard disk. The goal 
was to analyze the noise by means of accuracy measurements [S]. Therefore, positions 
of a trapped microsphere were recorded at sampling frequencies of up to 100 kHz in 
the order of hours. A short time series is plotted in Figure |3]\. 
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Experimental details are provided in Reference [S]. The positions were sampled 
using a photodiode detection system yielding an output in Volts, which were refor- 
mulated in terms of metric distances by a calibration factor. Figure [3j3 shows the 
positional power spectrum, which, when properly analyzed, gives information about 
the calibration factor as well as the strength of the optical trap [12j. A different type 
of time series analysis, Allan variance analysis, is excellent for quantifying noise in 
optical trapping assays HI], in particular in the low frequency regime, which is 
not possible through normal variance or power spectral analysis. Figure [3p shows 
the Allan deviation of the same trace quantifying the exact accuracy for various 
measurement intervals. For this type of analysis it is crucial to have long overall 
measurement time series and reliable streaming of the data onto the hard disk, a 
requirement met by TimeSeriesStreaming.vi. The modular fashion of the pro- 
gram enables straight forward implementation of similar types of calibration or noise 
quantification routines. 

5.2. Ionic Current through Glass Capillary 

The translocation of molecules through solid-state nanopores has drawn a lot of 
attention in recent years due to the enormous potential they hold for parallel screen- 
ing of biomolecular solutions [13] . Also, glass capillaries with a diameter of 60 nm 
could be used to detect DNA folding [6]. Here, we used TimeSeriesStreaming.vi 
to stream the the ionic current measured onto the computer hard disk. A sketch of 
the experiment is shown in the lower right of Figure |4j The measured current values 
are plotted, and in the upper left there is a zoom-in to illustrate that data acquisition 
was done at a very high rate (1.25 MHz). In this experiment, the error rate was zero. 
Hence, time series can be analyzed for events happening within sub-milliseconds, the 
timescale relevant for protein translocation through a nanopore [H], or for events 
happening on the order of minutes, a typical timescale for drift, as also visible on 
Figure |4| 

6. Summary 

We developed a Lab VIEW program that reliably streams large amounts of data 
correctly onto a computer hard disk. The program was checked on several individual 
platforms and showed to perform with a very small error rate. The program is made 
in a modular fashion with the aim of making it user-friendly and easily customizable. 
As an example, we showed how to acquire the positions of an optically trapped sphere 
and how this time series data can be further analyzed. We also demonstrated how 
the program streamed time series of ionic current measurements. As the program 
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Figure 4: Time series from measurements of monovalcnt-ionic current through a glass capillary 
(diameter 60 nm), a sketch of the experiment is shown in the lower right. The inset in the upper 
left is a zoom-in on the time axis, showing that the acquisition card's limit of 1.25 MHz sampling 
can be achieved. 



easily handles a broad range of analog inputs, there is a wide range of applications, 
particularly in biophysical nano-scale experiments as pointed out in the two exam- 
ples. The source code is freely available at through the CPC Program Library and 
under the standard CPC license agreement [T3] . 
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